Visible Light Communication System And Method

ABSTRACT

A system and method are provided herein for communicating with and controlling various devices using visible light communication (VLC). According to one embodiment, a method is provided for extending a communication range of a VLC system comprising a plurality of controlled devices and a remote control device. Such a method may include, for example, transmitting a communication message from a remote control device to a first controlled device located within range of the remote control device, wherein the communication message is transmitted through free space using visible light, and extending the communication range of the VLC system to a second controlled device, which is located outside of the range of the remote control device, by using the first controlled device to retransmit the communication message through free space using visible light to the second controlled device.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of currently pending U.S.patent application Ser. No. 15/953,202 filed Apr. 13, 2018, which is acontinuation of U.S. patent application Ser. No. 13/773,322 filed Feb.21, 2013, now U.S. Pat. No. 10,210,750, which claims priority to U.S.Provisional Application No. 61/601,153 filed Feb. 21, 2012. U.S. patentapplication Ser. No. 13/773,322 is further a continuation-in-part ofU.S. patent application Ser. No. 13/231,077 filed Sep. 13, 2011,currently abandoned. All of these applications are hereby incorporatedby reference in their entireties.

BACKGROUND 1. Field

This invention relates to visible light communication systems and, moreparticularly, to using remote control devices with cameras tocommunicate with controlled devices using visible light.

2. Description of Related Art

Remote controllers have become ubiquitous for controlling all sorts ofelectronic components, including TVs, sound systems, ceiling fans,projectors, computers, thermostats, lighting systems, etc. However, eachremote controller is typically unique for the particular associatedelectronic device. Universal remote controllers have had some successcombining functions in one handheld device; however, they are expensive,cumbersome, and subject to being lost.

Remote control can be useful for a number of different reasons. The mostcommon advantage is being able to change channels on a TV set withouthaving to move from the comfort of a chair or couch. Another advantageis being able to control a device, such as a light or ceiling fan thatmay be attached to a high ceiling and out of reach. Another advantage isthat having a remote controller can reduce the size and complexity ofthe device being controlled. For instance, the remote controller canhave multiple buttons and indicators or even a touch screen and computerfor controlling the device. This can enable the controlled device tosimply be configured to send and receive wireless data.

Remote controllers can communicate using a variety of wirelesscommunication protocols, but typically use infrared light or radiofrequency (RF) electromagnetic radiation based physical layers. Forexample, many commercial and residential lighting systems have remotecontrollers that enable lights to be controlled locally. However, theseremote controllers typically use infrared physical layers, which requirethe light fixtures to have infrared transceivers. This inevitablyincreases the cost of the lighting control system.

Some lighting control systems have been introduced that use visiblelight communication (VLC) to communicate optical data to light fixturesor other devices. Lighting control systems that use VLC have manyadvantages over conventional lighting control systems that use infraredremote controllers and transceivers, or employ other types of wired andwireless communication protocols. One big advantage is that the visiblelight spectrum is currently globally unregulated and does not sufferfrom the congestion and interference common in RF-based communicationsystems. Another advantage is cost savings.

For example, light fixtures controlled by visible light do not useinfrared transceivers for communicating with infrared remotecontrollers, and thus, do not incur the costs associated withconventional lighting control systems. In addition, a lighting controlsystem employing visible light communication may transmit optical datausing the same light fixture used to provide illumination, e.g., in aroom of a building. In the case that the light fixture comprises one ormore LEDs, the LEDs can also be used as light detectors for receivingoptically transmitted data. Finally, no dedicated wires are needed in asystem that transmits optical data using visible light traveling throughfree space. This is especially important for installation of lightingcontrol systems in existing buildings. These advantages, and possiblyothers, enable the visible light communication protocol to beimplemented within a lighting control system for very little cost.

A limitation of the visible light communication protocol, andspecifically, a protocol that transmits optical data using visible lighttraveling through free space, is that it is typically limited incommunication range and generally restricted to line of sight. In otherwords, optical data transmitted through free space typically cannot becommunicated around corners or through walls between various rooms in abuilding, or between light fixtures and other devices that are too faraway and outside of the optical communication range of the remotecontrol device. Therefore, a need exists for a system and method thatcan extend the communication range in a visible light communicationsystem.

SUMMARY

A system, remote control device and method are provided herein forcommunicating with and controlling various devices using visible lightcommunication (VLC). According to one embodiment, the system and methoddescribed herein may use a smart phone, or other device, as a remotecontrol device to communicate with and control various other devicesusing optically modulated data transmitted through free space usingvisible light.

As used herein, the term “visible light” refers to a portion of theelectromagnetic spectrum that is visible to (can be detected by) thehuman eye, and typically includes wavelengths from about 390 nm to about700 nm. Electromagnetic radiation in this range of wavelengths is calledvisible light or simply light. In the system described herein, onlyvisible light sources are used to transmit optical data.

As used herein, the term “free space” refers to communication withinspace, but not confined to, for example, an optical fiber. Thus,transfer of data occurs optically, but not constrained within an opticalfiber or any other type of waveguide device, yet is free and able totravel optically in any non-obstructed direction.

As used herein, the term “smart phone” refers to any mobile phone thatuses RF transceivers to communicate bi-directionally according towell-known cellular protocols. In addition to RF transceivers, a “smartphone” as used herein may generally include a memory for storing one ormore software applications (typically referred to as smart phoneapplications or “apps”), a processor for executing the one or moresoftware applications and a display screen for displaying a graphicaluser interface associated with the software applications. The displayscreen may be a touch screen display comprising a backlight forilluminating the touch screen display and a touch sensitive surface forreceiving user input. In some cases, the smart phone may also include acamera and a camera flash.

In some embodiments, a smart phone configured for visible lightcommunication may use the camera flash as a light source and opticaltransmitter, and the camera image sensor as an optical receiver.However, the remote control device described herein is not limited to asmart phone, and the light source does not have to be a flash. Inalternative embodiments, a laptop computer, a desktop computer, ahand-held device, or a wall-mounted unit could operate as a VLC remotecontrol device, for example, by modulating the backlight of a displayscreen (or other light source) for the purpose of transmitting opticaldata to one or more controlled devices.

In some embodiments, the remote control device and the controlleddevices may each include one or more light emitting diodes (LEDs). LEDsare desirable as they can be alternately configured to receive light andto emit light. In addition, LEDs may be configured for transmittingoptical data by modulating the drive current supplied to an LED toproduce light modulated with data.

In one exemplary application, the remote control device described hereinmay be used to communicate with light fixtures and lighting systems forcontrolling such lights, and to enable the lighting system to provide acommunication channel between the remote control device and variousremotely controlled devices. Although described here in the context of alighting control system, the system, remote control device and methodprovided herein are not limited to such and may be configured forcontrolling a wide variety of controlled devices. For example, thedevices being controlled may be a light fixture, a thermostat, asecurity system component, a TV, a ceiling fan, a home appliance orother type of remotely controlled electronic device.

According to one embodiment, a remote control device (e.g., a smartphone) may transmit data to a controlled device by modulating the lightproduced by the LED flash of a camera included within the remote controldevice. The device being controlled (e.g., a light fixture, a thermostator other type of remotely controlled device) may configure its LED as aphoto-detector to receive the data sent optically through free space bythe LED flash on the remote control device. Depending on the message,the controlled device can respond by driving it's LED with high currentmodulated with data to produce light modulated with data. The remotecontrol device may then detect this light and the data being modulatedusing an image sensor in the camera, for example.

In order to receive optically transmitted data from the remote controldevice, the LED(s) of the controlled device(s) may be periodically andmomentarily turned off to measure incoming light from the remote controldevice. This may be done at a relatively high rate (e.g., 360 Hz) thatcan't be seen by the human eye, and is preferably higher than themodulation rate of the light produced by the camera flash whentransmitting data. In some embodiments, the LED lights of the controlleddevices may be synchronized to a common source (e.g., an AC mains), andthus to each other, so that they all turn off at the same time, andconsequently do not interfere with data communication between eachother, the remote control device, or any other remotely controlleddevices. The times when the LEDs are not producing light are referred toherein as communication gaps.

According to one embodiment, a controlled device can measure theincoming light level during each communication gap, preferably using thesame LEDs used for emission, and produce a stream of data proportionalto the incoming light level. From such data streams, the controlleddevice may identify light level changes, which correspond to modulateddata transitions. Circuitry in the controlled device may decode the datato determine the message being sent by the remote control device.Depending on the message, each controlled device can respond to theremote control device by modulating the brightness and/or color of thelight being produced by its LED. Image processing software stored withinand executed by the remote control device may then be used to determinethe location of each controlled device and the data being communicated.

After transmitting a message using the LED camera flash, the remotecontrol device may turn on the camera's image sensor and record a videofor an amount of time anticipated for a response from the device ordevices being controlled. Software within the remote control device maythen analyze the video to determine the location of the device ordevices responding with light and the data being communicated. Forexample, the software may detect optically transmitted data by scanningone or more frames of video data for the brightness and potentiallycolor of the light emitted from the LED of a controlled device. Byanalyzing successive video frames, the software can determine when thebrightness and/or color of the light produced by a particular controlleddevice changes, which indicates transitions in the modulated data beingcommunicated from the controlled device to the remote control device. Inorder to ensure accurate detection, the transitions in the modulateddata should occur at a rate slower than the frame rate of the camera.

Although an LED or photodiode could be used for such purpose, the remotecontrol device described herein preferably uses a camera to receivelight emitted from the controlled devices. This is because cameras havetwo-dimensional image sensors, which typically have millions of pixelsthat can be used to detect light of different wavelengths that fallwithin the camera's field of view. By utilizing an image sensor, insteadof a discrete LED or photodiode, the image processing software withinthe remote control device can identify the location of many lightsources within the camera's field of view, and track the changes inbrightness and/or color over time. This enables the remote controldevice to receive data or messages from many controlled devicessimultaneously.

The method described so far enables a remote control device to broadcastmessages to all controlled devices located within a given communicationrange, and for all such devices within the field of view of the camerato communicate back to the remote control device. As set forth in moredetail below, the system and method described herein also enables aremote control device to communicate bi-directionally with anindividually addressed device.

According to one embodiment, a system and method is provided herein forestablishing a bi-directional communication link between a remotecontrol device and a selected one of the controlled devices. In somecases, the remote control device may initiate communication bybroadcasting a message to all controlled devices located within acommunication range of the remote control device, wherein such broadcastmessage includes a request to respond with a random number or uniquepre-programmed ID. The application software on the remote control devicecan then produce an image on the display screen showing all of thedevices detected within the camera's field of view, and identifying eachdevice that responded to the broadcast message. The user of the remotecontrol device can then touch one of the devices displayed in the imageto select that device for subsequent communication. A bi-directionalcommunication link between the remote control device and the selecteddevice is thereafter established by using the random number or unique IDof the selected device as an address in subsequent communicationmessages.

As an example, suppose there are 100 lights (controlled devices) in thehigh ceiling of an auditorium. The user may position the camera of theremote control device to take a picture of the 100 lights, or someportion thereof, and push a button provided by the graphical userinterface (GUI) on the touch screen of the remote control device. Theremote control device may then modulate light from the camera flash, forexample, to send a broadcast message to all lights that can receive themessage requesting those lights to respond with a random number orunique ID. The remote control device may then start recording a video.All lights that received the broadcast message may respond with therandom number or unique ID by modulating each light's output brightness(or color) with data. The application software within the remote controldevice may then analyze the video, identify the location (set of pixels)of each light within each video frame, determine the brightness (and/orcolor) of each light as a function of time, and determine the data beingsent from each light from changes in the brightness (and/or color) ofeach light over time.

From the data that the remote control device decodes from each light,the application software can make sure that all random numbers or IDsreceived are unique, and can display one frame of the video on the touchscreen display designating each light with a unique number and a circle,for instance. In some cases, the graphical user interface may allow theuser to zoom in on a region of the light to be adjusted, and select thatlight with a double touch, for instance. A menu could then pop up thatprovides buttons, sliders, etc. that enable the user to configure ormonitor various parameters, functions, etc., of the selected light. Suchparameters could be color, brightness, etc., or things like diagnostics,power consumption, or status could be read. For example, the camera onthe remote control device could be used to measure the color point ofthe light, and to provide feedback to the light to adjust the outputcolor to a particular color point or correlated color temperature (CCT).

Once the user selects something from the graphical user interface byselecting a touch screen button, for instance, a message may be sent tothe selected light using the random number or unique ID in the addressfield of the message transmitted by the camera flash. All lights withinrange will receive the message, however, only the selected light withthat random number or ID will respond. As such, bi-directionalcommunication with individual devices can be achieved.

According to another embodiment, a system and method is provided hereinfor increasing the optical power and extending the communication rangeof optical data transmitted in a visible light communication system.This embodiment uses the controlled devices themselves (e.g., themultitude of lights in an auditorium) to amplify the optical power ofthe messages transmitted by the remote control device, or messagestransmitted between controlled devices, in order to extend thecommunication range of the visible light communication system.

As used herein, a “communication range” refers to an opticalcommunication range, and specifically, a range of distances within whicha receiving device can receive optical data transmitted from a sendingdevice through free space using visible light. The communication rangeextends from the sending device up to a maximum distance at which areceiving device can receive optical data from the sending device. Areceiving device located beyond the maximum distance is said to belocated outside of the communication range of the sending device.

In a visible light communication system, the maximum distance may begenerally determined by the brightness and directionality of the visiblelight emitted by the sending device, as well as the light detectionsensitivity of the receiving device. In some cases, however, the maximumdistance may be affected by obstacles in the communication path (such aswalls or other optically dense structures in a room), or deviations froma straight line communication path (such as when light is to betransmitted around corners). The embodiment described herein increasesthe communication range of a visible light communication system by usingone or more of the controlled devices to retransmit the communicationmessages received by the controlled devices. Controlled devices mayreceive communication messages from the remote control device, and/orretransmitted communication messages from other controlled devices. Inaddition to amplifying the optical power of the communication messagestransmitted by the remote control device, the retransmission ofcommunication messages may enable controlled devices outside of thecommunication range of the remote control device to receiveretransmitted messages from controlled devices located within range ofthe remote control device.

In some cases, the communication range of the visible lightcommunication system may be extended by using one or more controlleddevices to amplify a sequence of communication messages transmitted by aremote control device. In general, the remote control device may beconfigured to send two (or more) communication messages sequentiallywith a fixed timing between each message. In one example, a firstcommunication message and a second communication may be sent by theremote control device, wherein the second communication message issubstantially identical to the first communication message.

The first message could be broadcast to all controlled devices withinrange of the remote control device, group cast to a set of controlleddevices, or uni-cast to an individual controlled device. The firstmessage may include a plurality of data fields, one of which containsinformation that the first message should be amplified or repeated bythe controlled devices that receive the first message. The controlleddevices that properly receive the first message may adjust their bittiming to that of the received first message and retransmit the firstmessage in synchronization with a second message being sent from theremote control device. Since the second message is substantiallyidentical to the first message, retransmitting the first message insynchronization with the second message effectively increases theoptical power of the second message sent by the remote control device.By utilizing the optical power of the controlled devices to amplify thesecond message sent by the remote control device, the optical power andcommunication range of the second message can be orders of magnitudelarger than simply relying on the optical power of the remote controldevice alone.

In other cases, the communication range may be extended by using one ormore controlled devices to retransmit a communication message sent fromthe remote control device, wherein the communication message isretransmitted by the controlled devices a specified number (N) of times.As in the previous case, the communication message may include aplurality of data fields, one of which contains information that thecommunication message should be retransmitted by the controlled devicesthat receive the communication message. In this example, thecommunication message may contain a repeat field that specifies a number(N) of times the communication message should be retransmitted by thecontrolled devices. In general, the number ‘N’ may be substantially anynumber greater than or equal to one. Controlled devices that receive thecommunication message from the remote control device decrement thenumber (e.g., N-1) in the repeat field of the received message, andretransmit the communication message with the decremented number in therepeat field of the retransmitted message.

In this case, the remote control device may be configured for sendingonly one communication message (i.e., a first communication message) tonearby controlled devices within range of the remote control device.After decrementing the number (N) in the repeat field of the receivedmessage, the nearby controlled devices may retransmit the communicationmessage to controlled devices outside of the communication range of theremote control device. In this manner, the communication range may beextended by using the controlled devices to relay messages to otherdevices.

Unlike the previous case, the controlled devices do not synchronizeretransmissions to the bit timing of the received first message.Instead, the controlled devices may be synchronized to a common timingreference, and thus, may communicate in synchronization with each other.By synchronizing the timing of the controlled devices to a common timingreference, the controlled devices can receive and retransmitcommunication messages to other controlled devices in synchronizationwith each other.

In one embodiment, the controlled devices may be coupled to a commonpower source, such as the AC mains of a building, and may besynchronized to a common timing reference generated from the AC powersource. For example, the controlled devices may each comprise aphase-locked loop (PLL) configured to generate the common timingreference by locking onto an AC signal provided by the AC power source.

Regardless of how the retransmitted messages are synchronized, theretransmit command may be used to communicate with a device to becontrolled when that device is very far away, but within line of sightof the remote control device. In this case, the light source (e.g. thecamera flash) on the remote control device may not have sufficientoptical power to send messages to a distant controlled device. In orderto reach the distant controlled device, the remote control device maysend one or more communication messages comprising retransmit commandsto nearby controlled devices, possibly at the user's discretion. Thenearby controlled devices receive the first communication message andretransmit the first communication message to other controlled devices.In some cases, the first communication message may be retransmitted insynchronization with a second message transmitted from the remotecontrol device to amplify the total transmitted optical power of thesecond message. In other cases, the first communication message may beretransmitted in synchronization with a common timing referencegenerated within the controlled devices. By retransmitting or relayingcommunication messages in such a manner, the distant controlled devicemay be able to receive the communication message and respondaccordingly.

In some cases, a retransmit command may only be necessary whentransmitting messages from the remote control device to a controlleddevice, which is far away but located within the field of view of thecamera. This is because a camera is much more sensitive to incominglight than a simple LED connected to an amplifier. For example, a camerahas a lens that focuses light onto an image sensor having millions ofdetectors, while a simple LED measures the total light power coming infrom all directions. Therefore, if the LED of the controlled devicefalls within the field of view of the camera, communication from thecontrolled device to the camera can occur over relatively longdistances.

The retransmit commands described herein are not limited to messagessent from the remote control device to the controlled devices and canalso be sent bi-directionally and between controlled devices,themselves. This further extends the control and communication range ofthe system by enabling the remote control device to communicate withcontrolled devices that are not within the field of view or line ofsight of the remote control device. For instance, a remote controldevice (or even a device with just an LED for transmitting and receivinglight instead of a camera) could send a communication message containinga retransmit command to nearby devices, which would receive andretransmit the communication message in different directions. Not onlywould this increase the transmit optical power of the message, but acontrolled device could receive a message from a controlling devicelocated around a corner, for instance.

A controlled device that is not in the line of sight of a remote controldevice, or any controlling device with or without a camera, can alsocommunicate back to the controlling device using the retransmit commandsdescribed herein. Thus, bi-directional communication is made possiblebetween the controlling and the controlled devices by using theretransmit commands to relay communication messages around corners.

In some cases, the retransmit commands can be used to retransmitmessages many times. For instance, a sending device (e.g., either aremote control device, a controlled device, or any device that cancommunicate using visible light) could specify that a communicationmessage be retransmitted any number of times by including the number ina repeat field of the communication message. Upon receiving thecommunication message, a controlled device may decrement the numberspecified in the repeat field of the received message and retransmit thecommunication message with the decremented number in the repeat field ofthe retransmitted message. Controlled devices that receive theretransmitted message will retransmit the received message in accordancewith the decremented number in the repeat field.

As an example, a sending device could specify that the communicationmessage be retransmitted twice by storing a corresponding bit value inthe repeat field of a communication message. Nearby controlled deviceswithin range of the sending device will receive the communicationmessage and retransmit the communication message twice, each time withthe bit value in the repeat field decremented accordingly. Controlleddevices that are outside the range of the sending device, but withinrange of the nearby controlled devices, will receive the firstretransmitted communication message and transmit the final communicationmessage in synchronization with the controlled devices within range ofthe sending device. Any number of retransmissions is possible, which canprovide virtually unlimited communication range.

According to another embodiment, a system and method is provided hereinfor using a preamble and a Cyclic Redundancy Check (CRC) checksum inmessages sent by a remote control device or other device using light tominimize the probability of such devices responding to incorrect data.For example, the preamble may include a unique sequence that does notexist within the rest of the message. Only after the unique pattern isdetected, does a receiver begin decoding a message. A CRC checksumcalculated at the receiving device is compared to the CRC checksumgenerated at the transmitting device and sent with the message. Only ifboth checksums match does a receiving device accept a message.

In addition to providing error protection, the CRC checksum enables adevice manufacturer to provide remote control device applications thatcan communicate only with that manufacturer's devices. By programming aunique manufacturer ID into each controlled device and using such ID asa seed for the CRC checksum, only messages sent by applications that usethe same ID as the CRC checksum seed will be accepted.

Of course, the remote control device described herein is not necessarilylimited to communicating with devices provided by only one manufacturer.In some embodiments, the controlled devices can perform two CRC checkson all received messages using two different seed values. One seed valuecan be manufacturer specific, while the second seed can be common to allmanufacturers. In this way, applications can be written to control onlya specific manufacturer's devices, or all devices from allmanufacturers.

According to one embodiment, a memory medium is provided hereincontaining program instructions, which are executable on a processor ofa remote control device for communicating with and controlling one ormore controlled devices. In some cases, the program instructions maycomprise first program instructions, second program instructions andthird program instructions. The first program instructions may beexecutable for providing a user interface on a display screen of theremote control device. In general, the user interface may be configuredto receive user input for controlling the one or more controlleddevices, and in some cases, may be a graphical user interface (GUI). Thesecond program instructions may be executable for generating acommunication message based on the user input received by the userinterface. As described herein, the generated communication message mayinclude a plurality of data fields. In some cases, the plurality of datafields includes a repeat field that specifies the number of times thecommunication message should be retransmitted by controlled devices thatreceive the optically modulated data. The third program instructions maybe executable for modulating a visible light source of the remotecontrol device with data contained within the plurality of data fieldsto produce optically modulated data, which is transmitted from theremote control device through free space to the one or more controlleddevices.

In some cases, the program instructions may further comprise fourthprogram instructions, which are executable for configuring a lightdetector of the remote control device to receive optically modulateddata transmitted from the one or more controlled devices. Like theoptically modulated data transmitted from the remote control device, theoptically modulated data transmitted from the one or more controlleddevices may be transmitted through free space using visible light.

In some cases, the fourth program instructions may configure an imagesensor of the remote control device to capture a sequence of images ofthe controlled devices, and the program instructions may furthercomprise fifth, sixth, seventh and eighth program instructions. Thefifth program instructions may be executable for analyzing the sequenceof images to determine a location of the controlled devices, and todetermine the optically modulated data sent from the one or morecontrolled devices by detecting a change in light output from thecontrolled devices over time. The sixth program instructions may beexecutable for displaying one of the images of the controlled devices onthe display screen of the remote control device. The seventh programinstructions may be executable for enabling a user to select aparticular controlled device by touching a portion of the display screencorresponding to the location of the particular controlled device in thedisplayed image. The eighth program instructions may be executable forgenerating and directing subsequent communication messages to only theparticular controlled device. Additional and/or alternative programinstructions may also be included.

The visible light communication systems, methods and memory mediumsdescribed herein provide fundamental advantages that are practicallyimpossible with RF wireless communication protocols. Since thewavelength of RF electromagnetic radiation is orders of magnitude longerthan visible light, discrimination between multiple light sourcestransmitting simultaneously is not possible. With visible lightcommunication, the remote control device, or any device with a camera,can receive light from thousands of sources simultaneously. Further,since RF communication (e.g., Bluetooth) involves frequency and phasemodulation of transmitter carrier frequencies, which are generatedlocally and out of synchronization with other devices, the concept ofmessage amplification is not possible since multiple devicestransmitting simultaneously will interfere with each other, instead ofamplifying each other. As such, the visible light communication systemsand methods described herein have significant practical advantages overtoday's state of the art communication and control systems.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention may be better understood, and its numerousobjects, features, and advantages made apparent to those skilled in theart by referencing the accompanying drawings.

FIG. 1 is an exemplary illustration of a remote control system in whicha remote control device communicates with a plurality of controlleddevices using visible light, according to one embodiment.

FIG. 2 is an exemplary illustration of a remote control device (e.g., asmart phone) displaying icons for remote control applications.

FIG. 3 is an exemplary illustration of a remote control device (e.g., asmart phone) displaying a remote controlled lighting application.

FIG. 4 is an exemplary illustration of a remote control device (e.g., asmart phone) displaying a remote controlled HV AC application.

FIG. 5 is an exemplary block diagram of a remote control device (e.g., asmart phone), according to one embodiment.

FIG. 6 is an exemplary block diagram of a controlled device, accordingto one embodiment.

FIG. 7 is an exemplary timing diagram of communication between a remotecontrol device (e.g., a smart phone) and a plurality of controlleddevices.

FIG. 8 is an exemplary diagram of a message structure for acommunication sent from a remote control device and a response sent froma controlled device.

FIG. 9 is a timing diagram of an exemplary message encoding scheme.

FIG. 10 is a timing diagram of an exemplary message preamble.

FIG. 11 is an exemplary block diagram of a CRC encoder and decoder.

FIG. 12 is an exemplary circuit diagram to generate CRC codes.

FIG. 13 is an exemplary timing diagram for a controlled device receivinga remote control message.

FIG. 14 is an exemplary timing diagram for a controlled devicetransmitting data.

FIG. 15 is an alternative exemplary timing diagram for a controlleddevice transmitting data.

FIG. 16 is an exemplary timing diagram for a remote control device(e.g., a smart phone) receiving data using the camera.

The use of the same reference symbols in different drawings indicatessimilar or identical items. While the invention is susceptible tovarious modifications and alternative forms, specific embodimentsthereof are shown by way of example in the drawings and will herein bedescribed in detail. It should be understood, however, that the drawingsand detailed description thereto are not intended to limit the inventionto the particular form disclosed, but on the contrary, the intention isto cover all modifications, equivalents and alternatives falling withinthe spirit and scope of the present invention as defined by the appendedclaims.

DETAILED DESCRIPTION

Smart phones with touch screen displays and cameras with LED flash arebecoming commonplace, and typically include radio frequency (RF)transceivers for communicating bi-directionally, using the RF spectrum,according to cellular phone protocols for long-range communication andBluetooth protocols for short-range communication. Smart phones are notused to control lighting fixtures in conventional infrared-basedlighting control systems, because they do not contain the infraredtransceivers necessary for interfacing with these systems.

Recently, smart phones have been used to in lighting control systems tocommunicate with lighting fixtures, or with specialized appliancesattached to the fixtures, using radio frequency signals transmitted,e.g., from a Bluetooth radio. However, these lighting control systemsrequire the controlled devices (i.e., the lighting fixtures or thespecialized appliances) to also include relatively expensive andlimited-range Bluetooth radios. A need remains for a smart phone, orother similar device, that can be used as a remote control device forcommunicating with and controlling devices that do not include Bluetoothradios (or other RF receivers). In addition to lighting control systems,it is contemplated that such a remote control device may be used forcontrolling a wide variety of controlled devices using visible light.

Smart phone devices typically have substantial processing power and runsoftware applications that can be downloaded off the Internet andexecuted on the smart phone for many different purposes. Some of theseapplications are used to control the smart phone camera flash forfunctions unrelated to the camera, such as providing strobe lighting ora flashlight feature. While useful for seeing in the dark, theseapplications cannot be used to transmit optical data from the smartphone.

The remote control device described herein utilizes various softwareapplications that function to control a light source (e.g., a cameraflash or display screen backlight) of a smart phone, or other device,for the purpose of sending and/or receiving optical data to/from avariety of controlled devices using visible light. Different softwareapplications can be used to control different devices. The softwareapplications described herein can be downloaded (e.g., from theInternet) or otherwise stored onto a memory medium of the remote controldevice, and generally consist of program instructions that may beexecuted by a processor of the remote control device to effectuatevisible light communication between the remote control device and one ormore controlled devices.

Turning now to the drawings, FIG. 1 depicts one example of a remotecontrol system 10 that uses the flash and camera of a smart phone 11 tocontrol light fixture 12 and other devices using visible light. In theparticular embodiment depicted in FIG. 1, remote control system 10comprises smart phone 11, light fixture (or lamp) 12, and thermostat 13in room 15. Thermostat 13 connects to the HVAC system 14 though wire 20.

In the exemplary embodiment of FIG. 1, smart phone 11 modulates thelight 16 produced by the flash to transmit optical data through freespace to lamp 12 and thermostat 13. Lamp 12 and thermostat 13 canrespond to messages from smart phone 11 through modulated light 18 and19, respectively. Modulated light 18 and 19 is recorded and decoded bysmart phone 11 using its camera in this example. Lamp 12 can also repeatmessages that are communicated through modulated light 17 to extend thecommunication range of messages sent from smart phone 11 to otherdevices, which may be too far away or out of the line of sight of smartphone 11, such as thermostat 13 or additional lamps or devices (notshown).

FIG. 1 is just one example of many possible remote control systems 10.For instance, smart phone 11 can control substantially any type ofcontrolled device having a light sensor, and optionally, a lightemitter. Examples of possible controlled devices include, but are notlimited to, security systems, ceiling fans, televisions, homeappliances, and a wide variety of other types of electronic devices. Itis also noted that the remote control device does not have to be a smartphone, and the light source on the remote control device does not haveto be a flash. In general, the remote control device described hereinmay be substantially any type of electronic device having at least acamera and a light source. As an example, a laptop computer, a desktopcomputer, a hand-held unit or a wall-mounted unit could operate as aremote control device, for example, by modulating the backlight of adisplay screen (or other light source) for the purpose of transmittingoptical data to a lamp or other type of remotely controlled device.

The remote control system 10 is not limited to the embodimentspecifically illustrated in FIG. 1. For example, smart phone 11 couldsimply control one or more lamps 12 in remote control system 10, and maynot communicate at all with thermostat 13. In the example of FIG. 1,lamp 12 repeats messages from smart phone 11 once (via modulated light17) to extend the optical range of smart phone 11. However, any numberof lamps (or other type of controlled device with a light emitter) canretransmit messages any number of times to provide virtually unlimitedcommunication range. Such lamps or devices can retransmit insynchronization with each other, and optionally with smart phone 11, toamplify the optical signal communicated through free space using visiblelight. When communicating in synchronization, the optical signal growsin intensity with each repetition as additional devices join theretransmission.

Although visible light communication is preferred, smart phone 11 couldalso communicate using Wi-Fi, Bluetooth, or any other communicationprotocol with a controlled device comprising such communication protocolinterface and a light emitter, such as an LED. In this embodiment, acontrolled device may convert Wi-Fi messages, for example, to opticallymodulated signals, which are transmitted to and detected by othercontrolled devices in the system 10.

FIG. 2 is an exemplary illustration of smart phone 11 with a touchscreen display showing graphical user interface icons, for example,corresponding to three different remote control applications 21, 22, and23. In this example, applications 21, 22, and 23 can be provided by thesmart phone manufacturer, or downloaded by smart phone 11 via theInternet and appear as icons on the display. As known in the art, a usermay touch one of the icons shown on the display screen to open acorresponding application and invoke the program instructions associatedtherewith. In the exemplary embodiments shown in FIGS. 1-4, applications21 and 22 respectively control the lamp(s) 12 and thermostat 13 inremote control system 10. It is noted, however, that applications 21,22, and 23 are merely illustrations depicting essentially any type andany number of applications that may be used by a smart phone (or othertype of electronic device) for controlling any type and any number ofcontrolled devices.

FIG. 3 is an exemplary illustration of smart phone 11 displaying oneembodiment of a remotely controlled lighting application 21, whichcomprises sliders or buttons 30, 31, 32, 33, 34 and 35. In this example,group button 30 may be divided into many smaller buttons that enabledifferent groups of lights to be controlled independently. Brightnessslider 31 in this example can be adjusted to control the dimming levelof a lamp 12, a group of lamps, or all lamps within communication rangeof the system 10.

Color button 32 could be a set of buttons, a slider, or even a twodimensional region to adjust the color of a lamp 12. A set of buttonscould allow preset color points or Correlated Color Temperatures (CCTs)to be selected, such as 2700 K, 3000 K, 3500 K, and 5000 K. A slidercould allow a user to adjust the CCT of lamp 12 anywhere within acertain range. A two-dimensional region could enable a user to selectany color within the gamut provided by lamp 12.

Ambient button 33 could also be a set of buttons or a slider, forinstance, which could be used to adjust the relationship betweenbrightness and ambient light level. In one example, ambient button orslider 33 could be used to adjust the ambient light above which lamp 12would dim or turn off. The ambient light level could be a limit orthreshold about which lamp 12 is fully on, and below which lamp 12 isfully off. On the other hand, lamp 12 could gradually adjust brightnessas the ambient light level changes. Lamp 12 may implement hysteresis inthe case that lamp 12 turns fully on and off with ambient light level.

Timer 34 could be a set of buttons, a slider, or even a link to a moreextensive sub-menu to control when lamp 12 turns on and off. Forexample, timer 34 could enable a user to configure lamp 12 to turn on ata certain time of day and turn off at another time. As another example,timer 34 could enable a user to adjust the amount of time that lamp 12stays on after being turned on. As such, timer 34 represents a widerange of functionality associated with any timers in lamp 12.

Send button 35 can initiate the message transmission from smart phone 11to adjust any of the properties or functions provided by buttons 31, 32,33 and 34. For example, a user could first push a button within group 30to select a particular group of lamps, adjust the position of brightnessslider 31, and finally touch the send 35 button to adjust the brightnessof the lamps within the selected group. However, send button 35illustrates just one way to initiate the transmission of a message fromsmart phone 11 to lamp 12. As another example, any time a button orslider is adjusted a message can be sent to a controlled device (such aslamp 12). As another example, a message can be sent to a controlleddevice in response to a voice communication or any other type of inputto smart phone 11. In another example, a software program running on thesmart phone, or on another device connected to the smart phone, mayautomatically send messages to one or more of the controlled devicesbased on sensor output (e.g., ambient light detection), scheduling, orsome other factor. In general, any input can result in the smart phone11, or other electronic devices, transmitting a message optically tolamp 12 or device 13, for instance.

The functionality illustrated in FIG. 3 provides an example of commonfunctions that lighting application 21 might control through theexecution of program instructions stored within a memory of the smartphone 11. Many other functions and user interfaces are possible withdifferent sliders, buttons, and other means to control and monitor alighting system. Other functions could include color calibration inwhich the camera in smart phone 11 is used to determine the color pointof the light produced by a lamp 12. Smart phone 11 could then providefeedback to lamp 12 to adjust the color to a desired point. Likewise,other sensors and interfaces on smart phone 11 could be used to monitorother aspects of the light output from a lamp 12 and provide feedback.

FIG. 4 is an exemplary illustration of smart phone 11 displaying oneembodiment of a remotely controlled thermostat application 22, whichcomprises graphical user interface fields 40, 41, 42, and 43. Timeversus temperature field 40 could comprises buttons, sliders, or a linkto a sub-menu, or could comprise a two dimensional mapping of time ofday versus temperature that can be adjusted by a user via touch. Statusfield 41 could be a region of the display that reports HV AC status(such as heating, cooling, or fan) and current temperature for instance.Temperature field 42 could comprise a slider that enables a user toadjust the temperature continually over a range of temperatures. Sendbutton 43 could operate the same or differently from the Send 35 buttonshown in FIG. 3.

FIG. 3 and FIG. 4 are illustrations of possible software applicationsthat may be used for controlling lights and thermostats using visiblelight communication from a smart phone or other remote control device.However, a wide variety of application programs and user interfaces arepossible. Additionally, applications for controlling a wide variety ofcontrolled devices are also possible. Although visible lightcommunication is the preferred communication method, some applicationsmay communicate using Wi-Fi or any other protocol to a controlled devicethat accepts such protocol, but produces messages using modulated light.

FIG. 5 is an example block diagram of a smart phone 11 that uses visiblelight communication to control lamp 12 and thermostat 13. Smart phone 11comprises touch screen display 55 for displaying a graphical userinterface associated with software applications 21 and 22, for instance,and for optionally displaying images of devices to be controlled ormonitored. The software applications 21 and 22 may be downloaded (e.g.,from the Internet) or otherwise stored within a memory medium of smartphone 11, such as memory 54 depicted in FIG. 5. The softwareapplications 21 and 22 may be invoked, e.g., when a user touches an icon(not shown) displayed on the touch screen display 55. Once invoked, thesoftware applications 21 and 22 may be executed on a processor of smartphone 11, such as processor 58.

In addition to running applications 21 and 22, processor 58 receivesuser input through the touch screen display 55 and passes data to betransmitted to the camera flash controller 59. In some cases, the datasent from processor 58 to camera flash controller 59 may include acommunication message, which is to be transmitted optically viacontroller 59 and LED 60 to one or more controlled devices. In general,the communication message may include a plurality of data fields asshown, e.g., in FIG. 8 and described in more detail below. In somecases, the communication message may include a repeat field specifyingthe number of times the communication message should be repeated orretransmitted by a controlled device that receives the communicationmessage. Upon receiving the communication message, the camera flashcontroller 59 transmits optically modulated data by turning LED 60 onand off in response to the data sent from processor 58. In some cases,the optically modulated data may be produced in accordance with awell-known encoding scheme, such as the bi-phase encoding scheme shownin FIG. 9.

In the example shown in FIG. 5, modulated light 16 from LED 60 istransmitted to lamp 12 and thermostat 13. Lamp 12 and thermostat 13respond with modulated light 18 and 19, respectively. Camera 50, whichcomprises lens 51 and image sensor 52, measures the light produced bylamp 12 and thermostat 13 as a function of time. Optional imageprocessor 53 can compensate for non-idealities, among other things, andstore a video recording of lamp 12 and/or thermostat 13 in memory 54.Processor 53 or processor 58 can analyze the video recording todetermine the location of light sources on the controlled devices, whichcan include lamp 12 and/or thermostat 13, and can analyze the change inlight output over time to determine the data being sent from suchdevices. After analyzing the video recording, processor 53 or 58 canreport the response to the touch screen display 55, pass the data toanother program running on another computer, or store the data in memory54, for example.

Since smart phone 11 uses camera 50 to receive data, the smart phone 11can receive data from many controlled devices at the same time. In somecases, smart phone 11 can display a still image from the video recordingthat identifies the location of the controlled devices (e.g., lamp 12and thermostat 13) from which smart phone 11 received valid responses. Auser can then touch an image 56 of lamp 12 or an image 57 of thermostat57 to select that device for further communication.

FIG. 5 is just one block diagram depicting exemplary components andfunctionality that may be provided by smart phone 11. Smart phone 11 maybe configured differently in alternative embodiments. For instance,smart phone 11 could transmit optical data by modulating the light fromthe backlight of the display screen (instead of the flash 60), or coulduse an optional ambient light sensor to receive optical data (instead ofthe camera image sensor 52). Camera 50 could comprise different internalcomponents, such as the optional image processor 53. Processor 58 andmemory 54 could reside in the same integrated circuit or different ones.Smart phone 11 could communicate with many lamps or groups of lampsinstead of just lamp 12. Smart phone 11 could also communicate with manydifferent types of controlled devices instead of just lamp 12 andthermostat 13. In general, smart phone 11 may communicate simultaneouslywith substantially any number and any type of device within the field ofview of camera 50.

Smart phone 11 could also communicate, for example, using Wi-Fi oranother communication protocol to a controlled device having the sameprotocol interface and an optical emitter. The controlled device couldconvert received Wi-Fi messages to optical messages, and smart phone 11could use camera 50 to receive responses optically from the controlleddevices.

FIG. 6 is one example of a block diagram for lamp 12, which is connectedto AC mains 61 and comprises power supply 62, timing 63, VLC networkcontroller 64, physical layer interface (PLI) 65, LEDs 66, and memory67. Power supply 62 converts the AC power from AC mains 61 to DC power,which provides current to the LEDs 66 and voltage to the remainingcircuitry in lamp 12. Timing 63 typically comprises a phase locked loop(PLL) that locks to the AC signal provided by AC mains 61 and providestiming information to visible light communication (VLC) networkcontroller 64 and physical layer interface (PLI) 65. The timinginformation provided by timing 63 can be used to synchronize all lamps12 and other devices in the system 10, and in some cases, may also beused to time power supply 62 to minimize noise coupling into PLI 65.

PLI 65 typically comprises an LED driver circuit that producessubstantially DC current to produce illumination from LEDs 66 andmodulated current to transmit optical data from LEDs 66. The AC and DCcurrents provided by the LED driver circuit can be combined in many waysto produce illumination and transmit data using the same light source.For example, periodic time slots can be produced in synchronization withthe AC mains 61 during which the DC current is turned off and the ACcurrent is turned on to transmit optical data within the periodic timeslots, or communication gaps.

PLI 65 also typically comprises a receiver circuit that detects currentinduced in LEDs 66 when the LEDs 66 receive optical data transmittedusing visible light through free space. The receiver circuit includedwithin PLI 65 converts the photo-current induced in LEDs 66 to voltage,which is then compared to a reference voltage to determine a sequence ofones and zeros sent by the transmitting device.

VLC network controller 64 interfaces with PLI 65 and memory 67 toreceive optical data transmitted from a transmitting device usingvisible light through free space, to implement the functionality of lamp12, and in some cases, to re-transmit the received optical data duringcommunication gap times. The optical data received by LEDs 66 can beinterpreted by VLC network controller 64, stored in memory 67 and/orfurther processed. For instance, the brightness or color of LEDs 66 canbe adjusted by adjusting the substantially DC current applied to LEDs 66using the LED driver circuit included within PLI 65. Optical dataintended for other or additional electronic devices (such as thermostat13) can be stored in memory 67 and re-transmitted by PLI 65 and LEDs 66in various ways.

The block diagram illustrated in FIG. 6 is just one example of manypossible lamps 12, which are configured to receive optical datacommunicated through free space and re-transmit the received opticaldata to other electronic devices using visible light. In someembodiments, the configuration of lamp 12 may be substantially differentfrom the example shown in FIG. 6. For instance, lamp 12 could be DC orsolar powered, and thus, may not be connected to AC mains 61. AlthoughLEDs 66 are preferred, since they can be used as both a light source andlight detector, any type of light source may be included within lamp 12including, but not limited to, fluorescent tubes, compact fluorescentlights, incandescent light, etc. If an alternative light source is used,lamp 12 may comprise an additional light detector, such as a siliconphoto-diode, for receiving the optically transmitted data.

FIG. 7 illustrates an exemplary timing diagram for the visible lightcommunication illustrated in FIG. I between smart phone 11, lamp 12, andthermostat device 13. In the exemplary timing diagram of FIG. 7, smartphone 11 transmits a communication message 16 to lamp 12 through freespace using visible light. The communication message 16 may betemporarily stored, e.g., within memory 67 of lamp 12 (as shown in FIG.6). In the case that the thermostat 13 is too far away or out of theline of sight of smart phone 11, lamp 12 may retransmit communicationmessage 16 once (as communication message 17) to extend the range ofcommunication between smart phone 11 and thermostat 13. Lamp 12 andthermostat 13 transmit responses 18 and 19, respectively, which may besaved in smart phone 11 as video recording 70.

As shown in FIG. 7, smart phone 11 may send communication message 16twice, with the second time being in synchronization with the samecommunication message 17 being sent from lamp 12. Upon receiving thefirst communication message 16 from the smart phone 11, the lamp 12 mayadjust its bit timing to that of the first received message 16, andretransmit the message (as communication message 17) in synchronizationwith the second communication message 16 being transmitted by the smartphone.

As described in more detail below, communication messages 16 and 17 mayeach comprise a repeat field (81, FIG. 8) that specifies the number oftimes the message is to be repeated. In the example of FIG. 7, thecontent of the repeat field is ‘1’ during the first transmission ofcommunication message 16 from smart phone 11. In this example, lamp 12receives message 16 the first time it is transmitted, however,thermostat 13 is out of communication range and does not receive themessage 16 transmitted from smart phone 11. Both smart phone 11 and lamp12 decrement the repeat field and retransmit the communication message16/17. In the example of FIG. 7, message 16 and message 17 are the same,with the exception that message 16 is transmitted by smart phone 11 andmessage 17 is transmitted by lamp 12. Since message 17 and message 16are the same, and since they are transmitted in synchronization, theoptical power is increased, and the range of the optical signal isextended. This enables thermostat 13 to receive the second transmissionof the message 17 even though the thermostat 13 may be out ofcommunication range of smart phone 11.

In addition to a repeat field, communication messages 16 and 17 mayfurther comprise an address field (82, FIG. 8) that can specifybroadcast, group cast, or uni-cast messages. Broadcast messages targetall devices, group cast messages target groups of devices, and uni-castmessage target individual devices within signal range. In the example ofFIG. 7, communication messages 16 and 17 are broadcast to all devices,to which both lamp 12 and thermostat 13 respond with responses 18 and19, respectively. Smart phone 11 records a video 70 of the responses 18and 19 from lamp 12 and thermostat 13 and decodes the data from themodulated optical power detected by the pixels of image sensor 52. Insome cases, smart phone 11 can display an image from video recording 70to enable a user to select a particular device for subsequentcommunication, for example, by touching display 55 in the region of theparticular device in the image (see, e.g., FIG. 5).

As set forth below, communication messages 16 and 17 may furthercomprise a communication field (83, FIG. 8) that specifies the action tobe taken by an addressed device or devices. One command, which istypically broadcast or group cast, instructs all targeted devices torespond with a random number. When this communication is transmitted,smart phone 11 records the responses within the field of view of camera50 and recovers the random number transmitted from each device. A userof smart phone 11 can then select a particular device from the imagedisplayed on touch screen display 55 for subsequent communication, whichmay use the random number as the address (82, FIG. 8) for uni-castcommunication with the selected device. Such a mechanism is useful,among other things, for setting an individual or group address for eachlamp or device when commissioning a new lighting system, for instance.

FIG. 7 represents just one of many possible timing diagrams for visiblelight communication between smart phone 11, lamp 12 and thermostat 13.In some cases, smart phone 11 may send communication message 16 onlyonce, instead of the two times shown in FIG. 7. In this case, thedevices being controlled by smart phone 11 (e.g., lamps 12 and possiblythermostat 13) may be synchronized to something other than the bittiming of the first communication message 16. In one embodiment, thecontrolled devices may be coupled to a common power source, such as theAC mains of a building, and may be synchronized to a common timingreference generated from the AC power source. In such an embodiment, thecontrolled devices may include a phase-locked loop (PLL) for generatingthe common timing reference by locking onto the AC signal provided bythe AC power source. By synchronizing the timing of the controlleddevices to a common timing reference, the controlled devices are able toreceive and retransmit communication messages to other controlleddevices in synchronization with each other. This eliminates any need forthe controlled devices to be synchronized to remote control device.

Alternative remote control systems 10 having possibly many differenttypes and/or numbers of controlled devices may operate in accordancewith substantially different communication timing diagrams. Forinstance, communication messages may not be repeated at all, or may berepeated many times. In some cases, communication messages may targetindividual devices in which only one controlled device may produce aresponse. In some cases, no responses may be provided. In other cases,responses from controlled devices may be repeated by other controlleddevices to extend the communication range of responses sent from thecontrolled devices back to the smart phone 11. Further, smart phone 11,or any other type of device that initiates optical communication, maynot have or make use of a camera 50, and consequently, may not recordvideo 70.

FIG. 8 illustrates an exemplary remote control message structure formessage 16 and 17 and responses 18 and 19. In the illustratedembodiment, communication messages 16 and 17 comprise preamble field 80,repeat field 81, address field 82, command field 83, data field 84, andCRC checksum 85. In the example of FIG. 8, the preamble field 80comprises bits 0 through 3, the repeat field 81 comprises bits 4 through7, the address field 82 comprises bits 8 through 15, the command field83 comprises bits 16 through 23, the data field 84 comprises bits 24through 31, and the CRC checksum 85 comprises bits 32 through 39.

The preamble field 80 identifies the start of communication message16/17 or response 18/19 and comprises a unique data sequence or patternthat does not exist within the rest of message or response. Forinstance, preamble 80 may include a coding violation (e.g., as used inbi-phase coding) or a control symbol (as used, e.g., in 4b5b or 8b10bcoding). Receiving devices, such as lamp 12 and thermostat 13, identifythe start of a message 16/17 when the unique pattern in preamble 80 isdetected. In some embodiments, receiving devices may also synchronizetheir internal timing to the bit timing of preamble 80, which enablesdevices without accurate timing references (e.g., PLLs) to communicateeffectively.

The repeat field 81 instructs a receiving device to retransmit areceived communication message 16 by specifying the number of times themessage 16 is to be repeated by the receiving devices. In the example ofFIG. 8, the repeat field 81 comprises four bits, which enables message16 to be repeated up to 15 times. In some applications, all controlleddevices that receive message 16 with a non-zero repeat field maydecrement the value in the repeat field and retransmit message 16 insynchronization with other devices including smart phone 11. In someapplications, all devices except smart phone 11 may repeat messages 16.In some applications, only some types of devices may repeat messages.The mechanism for repeating and amplifying the optical power of messagesis available and can be used in many ways.

The address field 82 specifies the controlled device or devices targetedby the communication message 16. In some cases, address field 82 mayinclude one particular code, for instance 0xFF, to indicate a broadcastmessage to be transmitted to all devices. In other cases, address field82 may include a range of codes that identify a group of devices totarget. For instance, the four most significant bits (8 through 11)being high can indicate a group cast message with the four leastsignificant bits (12 through 15) indicating one of sixteen differentgroups of devices. In this example, all remaining codes could identifyuni-cast messages to individual devices. Further, a certain range ofuni-cast codes could be allocated for random number addressing asdescribed previously, with another range of uni-cast codes allocated forpre-programmed addresses.

The command field 83 specifies the action to be taken by the targetdevice or devices. Such commands and associated actions can be differentfor different types of devices. For instance, lamp 12 may interpret thecommand field 83 to perform the functions shown in application 21, whilethermostat 13 may interpret the command field 83 to perform thefunctions shown in application 22. Some codes within the command field83 can be reserved for system 10 management and interpreted the same byall devices. For instance, the code to respond with a random number thatcan be used for subsequent addressing could be the same for all devicesindependent of function. Other system management codes may be includedto support a variety of functions.

The data field 84 may contain information associated with each commandfield 83 code. For instance, the code to adjust the brightness of a lampmay include a data code value within data field 84 to indicate what thebrightness should be. As another example, the code to adjust the colortemperature of a lamp may include a data code value within data field 84to indicate the desired CCT. Some command field 83 codes may have nodata field 84 code associated therewith. For instance, the code to turnoff a lamp may not need any data information, and consequently, the datafield 84 may not be included with such command codes.

The CRC checksum field 85 contains a code that is determined by thesequence of data bits between the preamble 80 and the CRC checksum field85 and is typically used by a receiving device for error checking. CRCcodes are well known in the industry and can be implemented with avariety of polynomials. Both transmitting and receiving devices generatethe CRC code using the same polynomial and the same seed value. Atransmitting device sends the CRC code in the CRC checksum field 85 of amessage. When the message is received, a receiving device generates it'sown CRC code and compares the result to the code in the CRC checksumfield 85 of the received message. If the codes match, the message wasreceived properly. If the codes do not match, an error occurred, and themessage can be ignored.

In general, the seed value used to generate CRC codes can besubstantially any value, provided that the same seed value is used inboth the transmitting and receiving devices. To allow devices fromdifferent manufacturers to be independently addressed, differentmanufacturers can program unique seed values into their devices, whichin turn, can be stored within smart phone 11 for use in communicationswith those devices. The use of unique seed values enables the smartphone 11 applications to selectively communicate with only a specificmanufacturer's devices, and to ignore messages that may be transmittedfrom a different manufacturer's device. For example, since the seedvalues are different for different manufacturers, a CRC code generatedin a transmitting device from one manufacturer will not match the CRCcode generated in a receiving device from another manufacturer.Consequently, all messages received by the receiving device from thetransmitting device will produce errors and be ignored by the receivingdevice.

In order to allow some applications 21, 22, and 23 to communicate withall manufacturer's devices, all devices used in the system 10, includingthose made by different manufacturers, can be configured to generate twodifferent CRC codes using two different seed values when receivingmessages. One seed value can be manufacturer specific and the other seedvalue can be the same for all manufacturers. If either of the generatedCRC codes matches the value in the CRC checksum field 85 in the receivedmessage, an error is not generated, and the message is properlyprocessed by the receiving device.

In some cases, the message structure of responses 18/19 may be like themessage structure of communication messages 16/17. As shown in FIG. 8,for example, responses 18 and 19 may include a preamble field 80, arepeat field 81, a data field 84, and a CRC checksum field 85. Just asmessages 16 and 17 can be repeated on transmission, so can responses 18and 19. The repeat field 81 specifies the number of times a response isto be repeated. The data field 84 provides the device's response, or theinformation requested in the received message 16 and 17, to smart phone11 for instance. For example, in response to a broadcast message 16requesting such information, a device may include a random number orunique manufacturer ID within the data field 84 of response 18 or 19. Asdescribed above, the random number or unique manufacturer ID provided bythe device within the data field 84 may be used for subsequent uni-castmessages between the smart phone 11 and the device. As noted above, theCRC checksum field 85 in the response 18 or 19 can be generated usingany seed value, but typically would be generated using the seed valuefrom the received message 16/17.

FIG. 8 illustrates one of many possible message structures forcommunication messages 16/17 and responses 18/19; however, other messageand/or response formats may be used. For instance, the size and/or orderof any of the fields shown in FIG. 8 may be different. Further, otherfields can be added or some fields, such as the data field 84 may not beused. As such, FIG. 8 is just one exemplary message structure.

FIG. 9 illustrates an example coding scheme for communication messagesand responses, which is a well-known bi-phase coding scheme operating at60 baud. The LED 60 of common smart phones, such as Apple's iPhone 4,can be modulated at a frequency up to 60 times per second. This 60 Hzrate is indicated by clock 90 in FIG. 9. In order to transmit data bits91 from smart phone 11, the data bits 91 are first bi-phase encoded atthe 60 Hz rate to produce bi-phase encoded bits 92. The bi-phase encodeddata 92 transitions at the end of each data 91 bit period, and furthertransitions in the middle of a data 91 bit period when data 91 is high.As such, the data 91 bit rate in this example is 30 bits per second.

In the example of FIG. 9, LED 60 produces light when bi-phase encodedbits 92 are high (data 91 bit periods 1, 4, 5 and 7), and does notproduce light when bi-phase encoded bits 92 are low (data 91 bit periods2, 3, and 6). As such, the light produced by the LED flash 60 of smartphone 11 is modulated with bi-phase encoded data 92 at 60 baud, whichproduces a data 91 throughput of 30 bits per second.

Bi-phase coding is just one of many possible coding schemes that may beused for communicating communication messages 16/17 and responses 18/19.For example, a commonly known 4b5b and 8b10b coding scheme could beused, instead of bi-phase coding, or data 91 could be communicatedwithout any encoding. Further, LED 60 could be modulated faster orslower than 60 Hz, which increases or decreases data 91 throughput. Assuch, FIG. 9 is just one example of a data communication protocol thatmay be used in the remote control visible light communication system 10.

FIG. 10 illustrates an example preamble 100 code that may be includedwithin the preamble field 80 in communication messages 16/17 andresponses 18/19. Clock 90 illustrates one exemplary rate at which LED 60can be controlled. In this example FIG. 10, preamble 100 comprisesemitted light for three clock 90 cycles, no light for one clock 90cycle, light for one clock 90 cycle, and no light for three clock 90cycles. Since bi-phase encoded data 91 transitions every two clock 90cycles, preamble 100 contains two coding violations 101 that only occurin the preamble field 80 of messages 16/17 and responses 18/19. Preamble100 comprises the longest light pulses, three clock 90 cycles, and theshortest light pulses, one clock 90 cycles, which enables a receivingnode to properly synchronize to the timing of a transmitting device.

FIG. 10 illustrates just one of many possible preamble 100 data that maybe included within the preamble field 80 of messages 16/17 and responses18/19. For the bi-phase encoding example, many other preamble 100 datawith or without coding violations are possible. In addition, thepreamble 100 data can be shorter or longer than shown in FIG. 10. Ifmessages are encoded using other encoding schemes, such as 4b5b or8b10b, preamble 100 can be significantly different. In such codingschemes, preamble 100 can be a control symbol that is not used forencoding data 91.

FIG. 11 illustrates an example block diagram for CRC generation andchecking in transmitting 110 and receiving 111 devices, respectively. Intransmitting device 110, the data for the repeat 81, address 82,communication 83, and data 84 fields resides in memory 112. This data ispassed, along with preamble 116 and the CRC code generated by CRCgenerator 113, to multiplexer 114 for generating a communication messageor response. The data is also serially applied to CRC generator 113through input port 124. Seed value 115 provides the initial state of CRCgenerator 113 and can be substantially any value. In some cases, seedvalue 115 may include a manufacturer specific code used to providecommunication only with that manufacturer's devices, or a general codethat provides communication with all manufacturers' devices. Theresulting CRC code produced by CRC generator 113 is passed throughoutput port 125 and inserted by multiplexer 114 at the end of thecommunication message or response. Although not shown in FIG. 11 for thesake of brevity, the output of multiplexer 114 is typically encodedbefore being used to modulate the light produced by LED 60 in smartphone 11, for instance.

In receiving device 111, encoded data is recovered from the receivedlight and applied to AND gates 117 and 118. Message 16 bits 4 through31, which comprise the repeat 81, address 82, communication 83, and data84 fields, pass through AND gate 117 to memory 121 and CRC generator119. Message bits 32 through 39 pass through AND gate 118 to comparator120. Seed value 115 is also applied to CRC generator 119, which producesa checksum that is compared by comparator 120 to the CRC code containedwithin the CRC field 85 of the received message. If the generated andreceived codes match, no error is detected, and the received message isaccepted. If the codes do not match, an error is detected, and themessage can be ignored.

To support both manufacturer specific seed 115 values and general seed115 values, CRC generator 119 can produce two different checksums usingboth seed 115 values. If either resulting checksum from CRC generator119 match the CRC code contained within the CRC field 85 of the receivedmessage, no error is detected, and the message is accepted.

FIG. 11 is just one of many possible block diagrams for CRC generationand checking in transmitting 110 and receiving 111 devices. Thefunctionality illustrated in the block diagrams can be performed inhardware, software or a combination of hardware and software, and can beimplemented in many different ways. FIG. 11 is intended to berepresentative of basic functionality and is not restricted to anyparticular componentry or configuration.

FIG. 12 is an exemplary diagram illustrating one embodiment of how theCRC generators 113/119 shown in FIG. 11 may be implemented. As shown inFIG. 12, the CRC generator may include a data input port 124 and a CRCcode output port 125. In the example embodiment of FIG. 12, CRCgenerator 113/119 uses the polynomial XA8+X+1 to produce the resultingCRC code. In this example, exclusive OR gates 127, 128, and 129 producethe terms XA8, X, and 1 respectively, while data serially shifts throughregister bits 126. Seed value 115 provides the initial state forregister bits 126 and is loaded into register bits 126 through inputs S0through S1.

FIG. 12 illustrates just one of many possible block diagrams forimplementing CRC generator 113/119. The functionality illustrated in theCRC generator block diagram can be implemented in hardware, software ora combination of hardware and software. FIG. 12 is intended to berepresentative of basic functionality and is not restricted to anyparticular componentry or configuration.

FIG. 13 illustrates an exemplary timing diagram for a lamp 12 receivinga communication message 16. In the example of FIG. 13, lamp 12 isconnected to AC mains 61, the voltage of which is represented by 60 HzAC signal 90. Referring to FIGS. 6 and 13, the timing block 63 includedwithin lamp 12 phase locks to the 60 Hz AC signal from AC mains 61 andproduces repetitive communication gaps 133 in the light output 130 fromlamp 12. In the exemplary timing diagram of FIG. 13, the communicationgaps 133 occur at six times the AC mains 61 frequency, or approximately360 Hz. Between communication gaps 133, LEDs 66 can operate as lightemitters. During communication gaps 133, however, no light is produced,and LEDs 66 can operate as light detectors for receiving communicationmessage(s) 16 via light in 131 and data in 132.

During communication gaps 133, for example, the light 131 into the lamp12 is measured and passed to PLI 65 (FIG. 6), which filters successivelight measurements and produces the data in 132 signal. In theillustrated example, prior light in 131 transitions are detected at theend of the next communication gap 133 at times 134 and 135. Althoughsmart phone 11 may have a precise 60 Hz reference clock and lamp 12maybe be locked to the precise 60 Hz reference clock of the AC mains 61,the phase of the two 60 Hz reference clocks may be unknown. This isillustrated by the phase difference between light in 131 and data in132.

FIG. 14 illustrates an exemplary timing diagram for a lamp 12transmitting a message 17 relative to the AC mains timing signal 90. Thedata out signal 140 represents data bits of a message 17 to betransmitted by lamp 12. Light out 141 represents the light produced bylamp 12, which in this example is modulated by data out 140. AlthoughFIG. 14 indicates that light out 141 from lamp 12 is turned completelyon and off, the light out 141 from lamp 12 can be modulated between anytwo brightness levels, some of which may be observed as flicker andothers that may not be.

The rate of data out 140 is illustrated in FIG. 14 to be 30 bits persecond, or one bit for every two cycles of the 60 Hz reference clock 90of the AC mains 61, which can be readily detected by a camera 50operating at a 60 Hz frame rate. If camera 50 in smart phone 11 operatessubstantially faster than 60 Hz, the rate of data out 140 can be evenhigher. Likewise, if lamp 12 is communicating with other lamps ordevices with other optical detectors, the rate of data out 140 can alsobe higher. As such, FIG. 14 is an example of just one possible timingdiagram for transmitting a message via lamp 12.

FIG. 15 illustrates an alternative method for transmitting messages 17from a lamp 12 in which only the light 141 produced by lamp 12 duringthe communication gaps 133 is modulated by data out 140. In thisexample, other lamps 12 or devices locked to the AC signal of the ACmains 61 can detect such light modulation and properly receive the dataout 140 signal.

FIG. 16 illustrates an example timing diagram of camera 50 and a pixelwithin image sensor 52 of a smart phone 11 receiving a response 18/19.In this example, the video clock 160 within camera 50 is operating at a60 Hz frame rate. The light into the pixel through the lens 51 from alamp 12, for instance, varies as illustrated by light in 161. Light in161 could be generated by a lamp 12 operating with the transmit timingdiagram illustrated in the example of FIG. 14. In this example, thelight in 161 bit rate is half the 60 Hz frame rate and slightly out ofphase with the video clock 160.

During video frames 164 and 166, light in 161 is high and lowrespectively for the entire frame. In this case, the pixel voltageintegrates light in 161 over the entire 60 Hz cycle and produces amaximum difference between light and dark. During frames 163 and 165,however, the light in 161 is on part of the 60 Hz cycle and off part ofthe 60 Hz cycle, which results in the pixel voltage, or imagebrightness, to be at some intermediate level. With such timing, imageprocessing software in image processor 53 or processor 58 of smart phone11 can detect the modulation of light from a lamp 12 and properlyreceive a response 18/19. Additional image processing may also be usedto compensate for motion of the camera 50 or transmitting devices.

FIG. 16 is an illustration of possible timing and functionality ofcamera 50 and smart phone 11 receiving optical signals from a lamp 12 orother types of devices. Pixel voltage 162 is intended to simplyrepresent the relative brightness of pixels of within an image as afunction of time. Pixel voltage 162 may or may not represent the actualsignal in image sensor 52. Likewise, the data rate of light in 161 maybe faster or slower than the rate shown in FIG. 16. FIG. 16 is just oneexample.

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof are shown and describedby way of example. It should be understood, however, that the drawingsand detailed description thereto are not intended to limit the inventionto the particular form disclosed.

1. A visible light communication system comprising: a lighting fixturethat comprises a visible light source and a visible light detector,wherein the lighting fixture is configured to; generate a common timingreference; periodically turn off the visible light source based on thetiming reference; when the visible light source is periodically turnedoff, receive via the visible light detector visible light transmitted bya control device; decode data modulated onto the visible light receivedfrom the control device; receive a first message from the control devicevia the visible light detector while the visible light source is turnedoff; adjust a bit timing in response to receiving the first message; andbased on the adjusted bit timing, retransmit the first message via thevisible light source to at least one other lighting fixture such thatthe retransmitted first message is in synchronization with a secondmessage transmitted by the control device, the second messagetransmitted at a fixed time after the first message is transmitted, thesecond message substantially identical to the first message.
 2. Thevisible light communication system as recited in claim 1, wherein thelighting fixture is further configured to; be coupled to an alternatingcurrent (AC) power source; generate the common timing reference bylocking onto an AC signal provided by the AC power source; and using thetiming reference, synchronously modulate data onto visible lighttransmitted by the visible light source.
 3. The visible lightcommunication system as recited in claim 1, wherein the data modulatedonto the visible light comprises information indicating that the datamodulated onto the visible light either be retransmitted from thecontrol device or be retransmitted from the visible light source whenthe visible light source is periodically turned on.
 4. The visible lightcommunication system as recited in claim 1, wherein the data modulatedonto the visible light comprises a repeat field that specifies a numberof times the data modulated onto the visible light should beretransmitted.
 5. The visible light communication system as recited inclaim 1, wherein the data modulated onto the visible light comprises aplurality of data fields, which includes one or more of: a repeat fieldthat specifies a number of times the data modulated onto the visiblelight should be retransmitted; a preamble field containing a unique datasequence that identifies a start of the data modulated onto the visiblelight; an address field containing a code specifying a lighting fixturetargeted by the data modulated onto the visible light; a command fieldcontaining a code specifying an action to be taken by the lightingfixture; a data field containing a data value associated with thecommand field code; and a Cyclic Redundancy Check (CRC) checksum fieldcontaining a CRC code.
 6. The visible light communication system asrecited in claim 1, wherein the lighting fixture further comprises avisible light communication network controller configured to receivevisible light modulated with data sent from other lighting fixturesarranged in a communication network.
 7. The visible light communicationsystem as recited in claim 1, wherein the visible light detector is oneor more of a plurality of light emitting diodes (LEDs) used as thevisible light source.
 8. The visible light communication system asrecited in claim 1, wherein the visible light source comprises one ormore of a plurality of light emitting diodes (LEDs).
 9. The visiblelight communication system as recited in claim 1, wherein the visiblelight source and the visible light detector are coupled to an AC mainsand are synchronized with each other.
 10. The visible lightcommunication system as recited in claim 9, wherein a current suppliedto the visible light source is periodically decreased to producecommunication gaps at regular, periodic intervals of each cycle of theAC mains.
 11. A visible light communication method in a visible lightcommunication system comprising a light fixture comprising a visiblelight source and a visible light detector, the method comprising:generating a common timing reference; periodically turning off thevisible light source based on the timing reference; when the visiblelight source is periodically turned off, receiving via the visible lightdetector visible light transmitted by a control device; decoding datamodulated onto the visible light received from the control device;receiving a first message from the control device via the visible lightdetector while the visible light source is turned off; adjusting a bittiming in response to receiving the first message; and based on theadjusted bit timing, retransmitting the first message via the visiblelight source to at least one other lighting fixture such that theretransmitted first message is in synchronization with a second messagetransmitted by the control device, the second message transmitted at afixed time after the first message is transmitted, the second messagesubstantially identical to the first message.
 12. The visible lightcommunication method as recited in claim 11, the method furthercomprising; coupling the lighting fixture to an alternating current (AC)power source; generating the common timing reference by locking onto anAC signal provided by the AC power source; and using the timingreference, synchronously modulating data onto visible light transmittedby the visible light source.
 13. The visible light communication methodas recited in claim 12, wherein the data modulated onto the visiblelight transmitted by the visible light source comprises informationindicating that the data modulated onto the visible light transmitted bythe visible light source either be retransmitted from the control deviceor be retransmitted from the visible light source when the visible lightsource is periodically turned on.
 14. The visible light communicationmethod as recited in claim 12, wherein the data modulated onto thevisible light transmitted by the visible light source comprises a repeatfield that specifies a number of times the data modulated onto thevisible light transmitted by the visible light source should beretransmitted.
 15. The visible light communication method as recited inclaim 12, wherein the data modulated onto the visible light transmittedby the visible light source comprises a plurality of data fields, whichincludes one or more of: a repeat field that specifies a number of timesthe data modulated onto the visible light should be retransmitted; apreamble field containing a unique data sequence that identifies a startof the data modulated onto the visible light; an address fieldcontaining a code specifying a lighting fixture targeted by the datamodulated onto the visible light; a command field containing a codespecifying an action to be taken by the lighting fixture; a data fieldcontaining a data value associated with the command field code; and aCyclic Redundancy Check (CRC) checksum field containing a CRC code. 16.The visible light communication method as recited in claim 11, whereinthe lighting fixture further comprises a visible light communicationnetwork controller configured to receive visible light modulated withdata sent from other lighting fixtures arranged in a communicationnetwork.
 17. The visible light communication method as recited in claim11, wherein the visible light detector is one or more of a plurality oflight emitting diodes (LEDs) used as the visible light source.
 18. Thevisible light communication method as recited in claim 11, wherein thevisible light source comprises one or more of a plurality of lightemitting diodes (LEDs).
 19. The visible light communication method asrecited in claim 11, further comprising: coupling the visible lightsource and the visible light detector to an AC mains; and synchronizingthe visible light source and the visible light detector with each other.20. The visible light communication method as recited in claim 19,further comprising: supplying current to the visible light source; andperiodically decreasing the current supplied to the visible light sourceto produce communication gaps at regular, periodic intervals of eachcycle of the AC mains.